MEMORANDUM March 25, 2019 


TO: Courtney Busby 
Officer, Special Populations 


FROM: Carla Stevens 
Assistant Superintendent, Research and Accountability 


SUBJECT: APEX LEARNING ONLINE INSTRUCTION, 2017-2018 


The Apex Online Learning Report for 201 7—2018 describes district data trends of Apex Learning 
courses. Apex Learning is a district-funded virtual platform with online instructional course 
options for all students in grades 7-12. Apex Learning online courses are designed for credit 
recovery and original credit, including Advanced Placement (AP) and dual credit. Results 
presented in this report are aggregated by school year, district, grade level, campus, and 
demographic characteristics. 


Key findings include: 

e Since 2010, Apex Learning has been used across the district to offer students personalized, 
virtual high school courses for original or credit recovery and blended tutorial solutions. 
Despite shifts in how the online platform is utilized or the variations in the types of courses 
being taken, Apex Learning continues to be a widely-used resource for students and 
teachers throughout HISD. 

e Findings show a 19 percent decline in Apex courses, from 9,830 Apex course completions 
in 2014-2015 to 7,984 Apex course completions in 2017-2018. Further disaggregation by 
credit type reveals that the proportion of Apex courses for credit recovery has declined and 
the proportion of Apex courses for original credit has increased. 

e Analysis of the demographic characteristics of students enrolled in an Apex Learning course 
in 2017-2018 suggests that the profile of a student who took an Apex course may be different 
from the profile of other HISD students. In 2017-2018, when students who took an Apex 
course were compared to students who took other online courses and compared to student 
who took an online course other than Apex, students who took an Apex course were more 
likely to be identified as at risk and an English learner, but less likely to be identified as gifted 
and talented. 


Further distribution of this report is at your discretion. Should you have any further questions, 
please contact me at 713-556-6700. 
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Executive Summary 


Program Description 

In order to provide equitable opportunities and equal access to an effective, personalized education, the 
Houston Independent School District (HISD) offers Apex Learning, a district-funded virtual platform with 
online instructional course options, to all students in grades 7-12. Apex Learning online courses are 
designed for credit recovery and original credit, including Advanced Placement (AP), and dual credit. 


The purpose of this report is to provide district leaders with data trends to inform the monitoring of Apex 
Learning in HISD. This report analyzes the enrollment and performance of students enrolled in online 
courses through Apex Learning compared to other online platforms from 2014-2015 to 2017-2018. It 
identifies course completion rates by credit type, subject, and grade level, while incorporating student 
demographic information when appropriate. Moreover, this report provides additional analysis of APEX 
Learning course completion for 2016-2017 graduates. 


Highlights 

e Since 2010, Apex Learning has been used across the district to offer students personalized, virtual high 
school courses for original or credit recovery and blended tutorial solutions. Despite shifts in how the 
online platform is utilized or the variations in the types of courses being taken, Apex Learning continues 
to be a widely-used resource for students and teachers throughout HISD. 


e Findings show a 19 percent decline in Apex courses, from 9,830 Apex course completions in 2014— 
2015 to 7,984 Apex course completions in 2017-2018. Further disaggregation by credit type reveal 
that the proportion of Apex courses for credit recovery has declined and the proportion of Apex courses 
for original credit has increased. 


e Analysis of the demographic characteristics of students enrolled in an Apex Learning course in 2017-— 
2018 suggests that the profile of a student who took an Apex course may be different from the profile 
of other HISD students. In 2017-2018, when students who took an Apex course were compared to 
students who took other online courses and compared to student who took an online course other than 
Apex, students who took an Apex course were more likely to be identified as at risk and an English 
learner (EL), but less likely to be identified as gifted and talented (G/T). 


Recommendations 

e Future qualitative research with campus leadership at specific high schools might explore the reasons 
why the absolute number of online courses and proportion of Apex courses by credit type have 
fluctuated each year 


e Future research should continue to explore demographic trends in students who take Apex courses. 
This data analysis could inform continuous improvement strategies specific to Grad Lab programs or 
on the collaborative development of new courses with Apex Learning, Inc. 


e Future research may explore the differences in instructional quality and student readiness between 
fully-online Apex courses, blended Apex courses, and Apex as an instructional supplement. In order to 
conduct such analyses, senior leadership may consider collecting additional metrics or information that 
would identify the way in which a campus or classroom is using Apex with their students. 
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Introduction 


In an effort to provide equitable opportunities and equal access to an effective, personalized education, the 
Houston Independent School District (HISD) offers online instructional course options to all students in 
grades 7-12. The largest of these district-funded virtual platforms is Apex Learning. The district began 
using Apex Learning courses in January 2010 through its Graduation Laboratories (Grad Labs) located at 
each high school. Through the Grad Labs, also known as the APEX Credit Recovery Initiative, online 
courses were available as an alternative method for students who need to complete credit requirements for 
graduation. This initiative placed computer labs with special APEX Learning software at 45 HISD high 
school campuses and graduation coaches at 24 of these campuses (HISD Research and Accountability, 
2012). 


Over time, additional Apex Learning resources have been offered to students throughout the district. 
Beginning in the 2013-2014 academic year, students in middle and high school were offered access to 
courses designed for credit recovery and original credit, including Advanced Placement (AP), and dual 
credit. In addition, individual schools had the option to contract for Apex Learning test review courses to 
support students preparing for state-mandated exams. Finally, Apex courses were made available to 
classroom teachers to be used as a supplement to instruction. 


Apex Learning is marketed as a comprehensive online platform that offers personalized, virtual high school 
courses for original or credit recovery, and blended tutorial solutions. According to literature from the 
company, “Apex Learning comprehensive courses enable schools to meet these challenges by making 
rigorous content accessible and engaging through the use of active learning strategies and opt-in 
scaffolding delivered at students’ differing levels of academic readiness” (Apex Learning, 2013). 


The purpose of this report is to provide district leaders with data trends to inform the monitoring of Apex 
Learning in HISD. This report analyzes the enrollment and performance of students enrolled in online 
courses through Apex Learning compared to other online platforms from 2014-2015 to 2017-2018. It 
identifies course completion rates by credit type, subject, and grade level, while incorporating student 
demographic information when appropriate. Moreover, this report provides additional analysis of APEX 
Learning course completion for 2016-2017 graduates. 


Methods 


Data Collection and Analysis 

e Online course completions were drawn from Chancery and saved as Historical Grades files for the 
corresponding year. Courses completed during the academic year and the following summer are 
included in the counts of courses. Apex Learning courses include those designated as APEX (Apex 
Learning) and APEXIS (Apex Learning Instructor Supplemented). 


e Courses for original credit, credit recovery, and review courses for state-mandated tests were counted 
using local course names from Chancery. AP courses were counted using state numbers that began 
with “A” from Chancery. 


e Graduates are defined as the count and percentage of students who graduate from any HISD high 


school at some time during the school year. The total for each respective year includes summer 
graduates, all students in grade 12 who graduated, graduates from other grades, and students served 
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by special education who graduate. This report does not include the four-year longitudinal graduation 
for the percentages of students from a class of students beginning in ninth grade who graduate, remain 
enrolled, and receive a Texas Certificate of High School Equivalency (TXCHSE). 


e State of Texas Assessments of Academic Readiness End of Course (STAAR EOC) results included 
those for the five tests required for graduation. Students take the associated EOC exam when they 
complete Algebra |, Biology, English |, English Il, and U.S. History regardless of grade level. Following 
a multi-year phase-in of standards, the following four performance categories for STAAR were 
implemented in spring 2017: Masters Grade Level, Meets Grade Level, Approaches Grade Level, and 
Did Not Meet Grade Level. The passing standard for STAAR EOC results is indicative of performing at 
or above the Approaches Grade Level Standard for all students (first time and retesters combined) by 
subject. Test files contain both initial test and retest scores; only students’ highest test results in each 
subject were included in the analyses. 


Data Limitations 

In some cases, duplicate course listings were found in the list of online course completions. Duplicates 
were identified as observations in which the student, course, final grade, and credits earned were entered 
more than once. Duplicates may have occurred if the system automatically documented course completions 
and the completions were also manually entered at the school level. 


Beginning in 2014-2015 school year House Bill (HB) 5 required the Commissioner of Education to adopt a 
transition plan to implement HB 5 and replace the Minimum High School Program (MHSP), Recommended 
High School Program (RHSP), and Distinguished Achievement Program (DAP) with the Foundation High 
School Program (FHSP). These rules allowed students who entered high school before 2014-2015, 
including 2017 graduates, the option to graduate under the new FHSP, the MHSP, the RHSP, or the DAP. 
Due to students’ ability to self-select between the former and current graduation plans, this report does not 
present descriptive statistics of 2017 graduates who took an Apex course by graduation plan. 


Due to the small number of students that took a STAAR EOC exam which corresponded with an Apex 
courses for credit recovery (n=98) in 2017-2018, this report did not compare of the rate of passing students 
who took the corresponding STAAR EOC credit recovery course through APEX with the rate of passing 
students who took the STAAR EOC credit recovery course in a traditional classroom. 


Since 2014-2015, one percent or less of Apex courses were classified as dual credit or Advanced 
Placement (AP). In 2017-2018, 22 HISD students completed 32 AP courses through Apex. Due to the 
small sample size, this report did not compare the rate of passing students who took the corresponding AP 
course through APEX compared with the rate of passing students who took the AP course in a traditional 
classroom. 
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Results 


What were the completion rates of all students enrolled in an APEX Learning course from 2014— 
2015 to 2017-2018? 


e Figure 1 shows the proportion of online courses, by Apex Learning or other provider! completed by 
students from 2014-2015 to 2017-2018. More details on online courses by provider since 2014-2015 
can be found in Appendix A (Table A-1, p.14). Across four years, from 2014-2015 to 2017-2018, the 
proportion of online courses taken through Apex Learning ranged from 68 to 77 percent. 


e In 2017-2018, 11,230 online courses were completed by 5,947 students. Of those courses, 71 percent 
(n=7,984) were completed through Apex Learning (Figure 1). 
Figure 1. Online Courses by Provider, 2014—2015 to 2017-2018 
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Source: Historical Grades Files, 2014-2015, 2015-2016, 2016-2017, 2017-2018 


e From 2014-2015 to 2017-2018, the number of online courses taken by HISD students declined 20 
percent, from 14,039 to 11,230 online courses (Figure 1). 


e Figure 2 (p. 5) shows the proportion of online courses by provider and credit type completed by 
students from 2014-2015 to 2017-2018. More details on course credit type by provider since 2014— 
2015 can be found in Appendix A (Table A-2, p.14) The absolute number of Apex online courses has 
decreased from 9,830 courses in 2014—2015 to 7,984 courses in 2017-2018. 


e Across four years, from 2014-2015 to 2017-2018, the majority of online courses through Apex 
Learning were for credit recovery or original credit. For each of these respective years, less than one 
percent of Apex courses were dual credit courses and less than one percent were Advanced Placement 
courses (Figure 2). 


' For readability of this report, Other Providers includes Houston Community College (HCC), HIL, Texas TechD (Texas Tech Distance 
Learning Program), TxVSN StU (Texas Virtual School Network), UT DL (University of Texas), and Additional Providers (API (American 
Preparatory Institute), Aventa, HVS, Nova Net, Penn Foster, Plato, SSCP, and Other Providers). 
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Figure 2. Online Courses by Provider and Credit Type, 2014-2015 to 2017-2018 
mCredit Recovery mDual Credit = Original Credit m Advanced Placement 


100% ° 0, ; 
80% 
oO 
& 60% 
Cc 
8 1% 
5 40% = 1% 49% 
7 1% 1% 
20% 45% 24% 4092 
A 0% 30% Pea : 
ee 10% ae 
fo} 
Apex Other Apex Other Apex Other Apex Other 
(n=9,830) Providers (n=8,357) Providers (n=8,286) Providers (n=7,984) Providers 
(n=4,209) (n=2,517) (n=3,883) (n=3,246) 
2014-2015 2015-2016 2016-2017 2017-2018 


Online Courses 


Source: Historical Grades Files, 2014-2015, 2015-2016, 2016-2017, 2017-2018 


e From 2014-2015 to 2017-2018, the proportion of Apex courses for credit recovery decreased by 17 
percentage points, from 45 percent (n=4,394) to 28 percent (n=2,243) of all Apex courses for each 
respective year (Figure 2). 


e Conversely, from 2014-2015 to 2017-2018, the proportion of Apex courses for original credit increased 
16 percentage points, from 55 percent (n=4,394) to 71 percent (n=5,708) of all Apex course for each 
respective year (Figure 2). 


What were the completion rates of 12'" grade students enrolled in an APEX Learning course from 
2014—2015 to 2017-2018? 


e Figure 3 shows the distribution of Apex courses for 12" grade students only from 2014-2015 to 2017- 
2018. More details on Apex course credit type by grade level since 2014-2015 can be found in 
Appendix A (Table A-3 and A-4, p. 15). 


Figure 3. Apex Courses by Credit Type, 12'" Grade Only as a Percentage of All 
Apex Courses, 2014—2015 to 2017-2018 
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e The absolute number of credit recovery courses for all grade levels through Apex Learning decreased 
by 49 percent, from 4,394 courses in 2014-2015 to 2,243 courses in 2017-2018. From 2014-2015 to 
2017-2018, the proportion of the Apex courses taken annually by 12th grade students for credit 
recovery has deceased nine percentage points; reaching its lowest percentage to date in 2017-2018 
(14 percent, n=1,116) (Figure 3, p.5). 


e Incontrast, the absolute number of original credit courses through Apex Learning increased six percent, 
from 5,388 courses in 2014—2015 to 5,708 courses in 2017-2018. From 2014-2015 to 2017-2018, the 
proportion of Apex courses taken annually for original credit by 12th grade students increased 11 
percentage points, reaching its highest percentage to date in 2017-2018 (37 percent, n=2,969) (Figure 
3). 


e Figure 4 presents the distribution of Apex courses for credit recovery by subject area for 12'" grade 
students only from 2014-2015 to 2017-2018. More details on the number of Apex courses for credit 
recovery by subject area for students in 12" grade since 2014-2015 can be found in Appendix A (Table 
A-5, p. 16). 


e = In 2014-2015, 2,250 of 4,394 Apex Learning courses for credit recovery were taken by 12" grade 
students. 2 Of these 2,250 courses, the greatest proportion (32 percent, n=727) were in the subject of 
English Language Arts (ELA). 


e From 2014-2015 to 2017-2018, the absolute number of 12‘ graders who took ELA credit recovery courses 
decreased from 727 courses in 2014—2015 to 260 courses in 2017-2018. 


Figure 4. Apex Courses for Credit Recovery by Subject Area, 12" Grade Only, 2014-2015 to 2017-2018 
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Source: Historical Grades Files, 2014-2015, 2015-2016, 2016-2017, 2017-2018 
Notes: The three subject categories with the highest proportions are represented. Annual percentages in this figure will 
not equal 100. For Apex courses for credit recovery by subject for 12'" grade students, see Table A-5, p.16. 


e In 2017-2018, the greatest proportion of credit recovery courses taken by 12" grade students were in 
the subject of Social Studies/History; of the 1,116 Apex credit recovery courses, 28 percent were for 
Social Studies/History (n=315). That same year, 2017-2018, 19 percent of Apex credit recovery 


? In 2014-2015, 45 percent of the 9,830 total Apex Learning courses were identified as credit recovery courses (n=4,394). 
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courses taken by 12" grade students were for a Language Other than English (n=206) (Table A-5, p. 
16). 


e Figure 5 presents the number of Apex courses for original credit by subject area for 12 grade students 
only from 2014-2015 to 2017—2018.3 More details on the number of Apex courses for original credit by 
subject area for students in 12" grade since 2014-2015 can be found in Appendix A (Table A-5, p.16). 


e In 2014-2015, 2,544 of 5,388 Apex Learning courses for original credit were taken by 12" grade 
students.*+ Of these 2,544 courses, the greatest proportion (32 percent, n=817) were for a Language 
Other than English, a non-core subject (Figure 5). 


e In 2017-2018, similar to Apex courses for credit recovery, the greatest proportion of Apex Learning 
courses for original credit taken by 12th grade students were in the subject of Social Studies/History; 
of the 2,969 Apex original credit courses, 30 percent were for Social Studies/History (n=904) (Figure 
5). 


e From 2014-2015 to 2017-2018, the proportion of Apex Learning courses for original credit taken by 
12th grade students in the subject of PE/Health increased by nine percentage points (10 percent to 19 
percent) (Figure 5). 


Figure 5. Apex Courses for Original Credit by Subject Area, 12'° Grade Only, 2014-2015 to 2017-2018 
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Source: Historical Grades Files, 2014-2015, 2015-2016, 2016-2017, 2017-2018 
Notes: The three subject categories with the highest proportions are represented. Annual percentages in this figure will 
not equal 100. For Apex courses for original credit by subject for 12" grade students, see Table A-5, p.16. 


What were the demographic characteristics of all students enrolled in online courses in 2016-2017 
and 2017-2018? 


e Figure 6 (p. 8) presents the proportion of students enrolled in Apex courses by grade level in 2016-— 
2017 and 2017-2018. More details on demographics for students enrolled in Apex Learning courses, 
other online courses, and the district for 2016-2017 and 2017-2018 can be found in Appendix A (Table 
A-6, p.17). 


3 The absolute number of total original credit courses through Apex Learning increased six percent, from 5,388 courses in 2014-2015 
to 5,708 courses in 2017-2018. 
4 In 2014-2015, 55 percent of the 9,830 total Apex Learning courses were identified as original credit courses (n=5,388). 
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In 2017-2018, 51 percent of students enrolled in Apex courses were in grade 12, a seven percentage 
point increase from the previous school year, 2016-2017 (Figure 6). 


For both 2016-2017 and 2017-2018, the proportion of students in 12'" grade who took an Apex course 
was higher than the proportion of students in 12" grade who took an online course from other providers 


(Figure 6). 


Figure 6. Comparative Composition by Grade for Students Enrolled in Online Courses by Provider, 
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Figure 7 compares the composition of students enrolled in Apex Learning courses and other online 
providers by At-Risk, Gifted/Talented (G/T), and English Learner (EL) indicators. More details can be 
found in Appendix A (Table A-6, p. 17). In both 2016-2017 and 2017-2018, the proportion of students 
enrolled in Apex Learning courses identified as at risk was higher than the proportion of students 
enrolled in other online courses identified as at risk. From 2016-2017 to 2017-2018, the proportion of 
at-risk students enrolled in Apex Learning courses increased 11 percentage points (67 percent to 78 
percent). 


Figure 7. Comparative Composition of Key Indicators for Students Enrolled in Online 
Courses by Provider, Grade 7-12 Only, 2016-2017 and 2017-2018 
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e =In both 2016-2017 and 2017-2018, the proportion of students enrolled in Apex Learning courses 
identified as G/T was lower than the proportion of students enrolled in other online courses identified 
as G/T. In 2017-2018, the proportion of G/T students enrolled in Apex Learning courses was 11 
percentage points lower (14 percent) than the proportion of G/T students enrolled in other online 
courses (25 percent) (Figure 7, p.8). 


e From 2016-2017 to 2017-2018, the proportion of EL students enrolled in Apex Learning courses 
increased by three percentage points (13 percent to 16 percent). In 2017-2018, the proportion of 
students enrolled in Apex Learning courses identified as ELs was seven percentage points lower than 
the proportion of EL students in grades 7-12 across the district (16 percent compared to 23 percent) 
(Figure 7). 


Of 2017 and 2018 graduates, how many completed at least one course through APEX Learning at 
any point in grades 9-12? 


e Figure 8 shows the rates of graduates who completed at least one Apex Learning course in HISD in 
grades 9-12 from 2010 through 2018. Additional information on 2017 and 2018 graduates by 
demographic characteristics can be found in Appendix A (Table A-7, p.18). Beginning in January 2010, 
Apex Learning was offered to graduating seniors in need of credit recovery. For the 2009-2010 school 
year, five percent of graduating seniors completed at least one Apex online course. 


Figure 8. Graduates Who Completed at Least One Apex Learning Course in HISD in Grades 
9-12, 2010 to 2018 
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2014 

* No data available because Apex Learning did not receive a district evaluation in the 2014-2015 and 2015-2016. 


e Of the 11,064 students who graduated from HISD in 2018, 30 percent (n=3,276) completed at least 
one Apex Learning course at any point in grades 9-12; the proportion of graduates completing an Apex 
course during high school increased by 25 percentage points from 2010 to 2018 (Figure 8). 


e Figure 9 (p.10) presents the demographic composition of 2017 and 2018 graduates by whether or not 
the graduate ever took an online learning course, and further disaggregates online courses by Apex 
Learning courses only. In 2018, compared to graduates who never took an online course (n=7,013) 
and to graduates who took an online course other than Apex Learning (n=775), graduates with at least 
one Apex course (n=3,276) were more likely to be ELs, and less likely to be G/T or receiving special 
education services. For 2017 and 2018 graduates by demographic characteristics and online course 
type, see Appendix A (Table A-7, p.18). 
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Figure 9. Comparative Demographic Composition of Graduates by Online Learning Course, 2017 


Sources: Historical Grades Files, 2014-2015, 2015-2016, 2016-2017, 2017-2018; Chancery Student Demographics, May 
2015, May 2016, May 2017, May 2018; 2017 Chancery Graduates File 
* N refers to students who took at least one Apex Learning online course during high school. This is a subset of graduates 
who completed at least one online course. 


e From 2017 to 2018, the proportion of graduates in the district identified as English Learners increased 
by five percentage points (17 percent to 22 percent). Correspondingly, the proportion of graduates in 
the district identified as English Learners with at least one Apex Learning course increased by six 
percentage points (18 percent to 24 percent) (Figure 9). 


e The proportion of 2018 graduates identified as English Learners with at least one Apex Learning course 
was three percentage points higher (24 percent) than 2018 graduates who never took an online learning 
course (21 percent) (Figure 9). 


e The proportion of 2018 graduates with a G/T identifier with at least one Apex Learning course was three 
percentage points lower (13 percent) than 2018 graduates who never took an online learning course 
(16 percent) and 15 percentage points lower than 2018 graduates who look an online learning course 
other than Apex (28 percent) (Figure 9 and Table A-7, p.18). 


In 2017-2018, how many credit recovery courses associated with STAAR EOC content were 
completed through APEX, and how many students who completed them met the passing standards 
on these exams? 


Table 1. Number of STAAR EOC Exams with Corresponding Apex Courses, by Passing Rate, 
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(N=10,613) Online Course Least One Apex course* (N=1 1,064) Online Course Least One Apex course* 
(n=6,507) Online Course (n=3,227) (n=7,013) Online Course (n=3,276) 
(n=4,106) (n=4,051) 
2017 2018 
Graduates 


2017-2018 
US Total by 
STAAR Proficiency Level Algebra | Biology English | English Il Hi EA a Passing 
y Standard 
Did not Meet Grade Level 10 6 10 21 13 60 
At or Above Approaches 
Grade Level : as : : uy ne 
Total STAAR EOC Exams by 15 10 18 26 29 98 
Subject 


Sources: Historical Grades Files, 2017-2018; Chancery Student Demographics, May 2018; STAAR EOC 2017-2018 Spring Final, 


June 21, 2018 
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e = In 2017-2018, four percent of the 2,243 Apex courses taken for credit recovery corresponded with a 
STAAR EOC exam (n=98); 38 percent of the Apex courses for credit recovery associated with a STAAR 
EOC exam corresponded with a passing standard of at or above Approaches Grade Level (n=38). 


Discussion 


For nearly a decade, Apex Learning has been utilized by the Houston Independent School District as the 
primary vendor for online courses for specific students who struggle to meet academic requirements, 
students who are high-performing but not sufficiently challenged, and students whose circumstances 
prevent them from attending traditional classes regularly enough to complete them. 


Since 2014-2015, the absolute number of all online courses completed in the district declined by 20 
percent. At the same time, findings show a 19 percent decline in Apex courses, from 9,830 Apex course 
completions in 2014-2015 to 7,984 Apex course completions in 2017-2018. Further disaggregation by 
credit type reveal that the proportion of Apex courses for credit recovery has declined annually since 2014— 
2015 to a rate of 28 percent of Apex courses used for credit recovery in 2017-2018. Conversely, from 
2014-2015 to 2017-2018, the proportion of Apex courses for original credit increased by 16 percentage 
points. The reason for this decline in Apex for credit recovery, and the corresponding increase in Apex for 
original credit is unclear. Senior leadership may want to understand why original credit has increased. One 
possibility for the increase in original credit is because schools may not be able to hire teachers with 
certifications in hard to staff areas, like languages other than English. Another possibility is that students 
may be self-selecting to enroll in lower-stakes, untested courses that are required for graduation, like 
History/Social Studies (excluding U.S. History) and Physical Education. Future qualitative research with 
campus leadership at specific high schools might explore the reasons why the absolute number of online 
courses and proportion of Apex courses by credit type have fluctuated each year (see Appendix A, Table 
A-8, p.19—20 for additional information). 


Analysis of the demographic characteristics of students enrolled in an Apex Learning course in 2017-2018 
suggests that the profile of a student who took an Apex course may be different from the profile of other 
HISD students. Analysis of 2018 graduates with at least one Apex course during their four years in high 
school compared to other graduates in the same year suggests that these graduates were more likely to 
be ELs, and less likely to be G/T. Notably, the proportion of 2018 graduates with a G/T identifier with at 
least one Apex Learning course was 15 percentage points lower than 2018 graduates who look an online 
learning course other than Apex. 


Analysis of Apex courses taken only in 2017-2018 tells a slightly different story. In 2017-2018, when 
students who took an Apex course were compared to students who took other online courses, students 
who took an Apex course were more likely to be identified as at risk and an EL, but less likely to be identified 
as G/T. In 2017-2018, at-risk students who took an Apex course (78 percent) were overrepresented in 
comparison to at-risk students in the district in grades 7—12 (69 percent), and the proportion of EL students 
who took an Apex course (16 percent) was lower than the proportion of EL students in the district in grades 
7-12 (23 percent). Additionally, in 2017-2018, the proportion of students with a G/T identifier with at least 
one Apex Learning course (14 percent) was 11 percentage points lower than students who look an online 
learning course other than Apex (25 percent) with a G/T identifier. Future research should continue to 
explore demographic trends in students who take Apex courses. This data analysis could inform continuous 
improvement strategies specific to Grad Lab programs or on the collaborative development of new courses 
with Apex Learning, Inc. 
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Across campuses and classrooms utilizing Apex Learning, courses are delivered in a variety of formats. 
Despite the variation in how it is used in the classroom, Apex learning, unlike other online learning platforms, 
requires additional oversight and compliance from the district, which theoretically could reduce the variation 
in the quality of implementation. However, Apex staff reported that an increasing number of Apex courses 
were used informally by classroom teachers to supplement their courses with a blended, online learning 
component (M. Bonilla, personal communication, July 19, 2018). In other words, Apex may be used as it 
was designed or it may be used in a way that supports other, face-to-face curriculum. Future research may 
explore the differences in instructional quality and student readiness between fully-online Apex courses, 
blended Apex courses, and Apex as an instructional supplement. In order to conduct such analyses, senior 
leadership may consider collecting additional metrics or information that would identify the way in which a 
campus or classroom is using Apex with their students. 


Since 2010, Apex Learning has been used across the district to offer students personalized, virtual high 
school courses for original or credit recovery, and blended tutorial solutions. Despite shifts in how the online 
platform is utilized or the variations in the types of courses being taken, Apex Learning continues to be a 
widely-used resource for students and teachers throughout HISD. 
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Appendix A 


Table A-1. Online Course Completions by Provider, 2014-2015 to 2017-2018 


2014-2015 


2015-2016 


2016-2017 


2017-2018 


% 


% 


% 


N 


% 


Apex Learning 


HCC (Houston Community College) 
HIL 


UT DL (University of Texas) 


Texas TechD (Texas Tech Distance 
Learning Program) 

TXVSN StU (Texas Virtual School 
Network) 


Additional Providers* 


9,830 
1,535 


819 


70.0% 


10.9% 


5.8% 


5.3% 


1.5% 


<0.1% 


6.4% 


8,357 


767 


655 


262 


127 


704 


76.9% 


7.1% 


6.0% 


2.4% 


1.2% 


<0.1% 


6.5% 


8,286 


2,243 


998 


196 


68.1% 


18.4% 


8.2% 


1.6% 


1.1% 


<0.1% 


2.5% 


7,984 


1,766 


836 


240 


109 


57 


238 


71.1% 


15.7% 


7.4% 


2.1% 


1.0% 


0.5% 


2.1% 


Total Online Course Completions 


14,039 


100.0% 


10,874 


100.0% 


100.0% 


11,230 


100.0% 


Sources: Historical Grades Files, 2014-2015, 2015-2016, 2016-2017, 2017-2018 
“Includes API (American Preparatory Institute), Aventa, HVS, Nova Net, Penn Foster, Plato, SSCP, and Other Providers 


Table A-2. Online Course Completions by Provider and Purpose, 2014-2015 to 2017-2018 


2014-2015 


2015-2016 


2016-2017 


2017-2018 


N 


% 


% 


% 


N 


% 


Apex Learning 
Credit Recovery 
Dual Credit 
Original Credit 


Advanced Placement* 


9,830 
4,394 
4 
5,388 
44 


Courses for which Credit was Awarded| 9,327 


Other Providers 
Credit Recovery 
Dual Credit 
Original Credit 


Advanced Placement* 


Courses for which Credit was Awarded| 4,053 


Total Online Course Completions 


14,039 


70.0% 
44.7% 
<0.1% 
54.8% 
0.4% 


8,357 
3,364 
al 
4,953 
39 


76.9% 
40.3% 
<0.1% 
59.3% 
0.5% 


8,286 
2,526 
2 
5,723 
35 


94.9% 7,939 95.0% 7,964 


30.0% 
10.1% 
24.5% 
63.5% 
1.9% 


2,517 
532 
408 

1,522 

55 


23.1% 
21.1% 
16.2% 
60.5% 
2.2% 


96.3% 2,379 94.5% 3,701 


100.0% 


10,874 


100.0% 


12,169 


68.1% 
30.5% 
<0.1% 
69.1% 
0.4% 
96.1% 
31.9% 
13.5% 
47.2% 
38.1% 
1.2% 
95.3% 


100.0% 


7,984 
2,243 
1 
5,708 
32 
7,790 
3,246 
545 
1,585 
1,086 
30 
3,017 


11,230 


71.1% 
28.1% 
<0.1% 
71.5% 
0.4% 
97.6% 
28.9% 
16.8% 
48.8% 
33.5% 
0.9% 
92.9% 


100.0% 


Sources: Historical Grades Files, 2014—2015, 2015-2016, 2016-2017, 2017-2018 

Notes: Other Providers includes Houston Community College (HCC), HIL, Texas TechD (Texas Tech Distance Learning Program), TxVSN StU (Texas Virtual 
School Netw ork), UT DL (University of Texas), and Additional Providers (API (American Preparatory Institute), Aventa, HVS, Nova Net, Penn Foster, 
Plato, SSCP, and Other Providers). 

“Includes AP classes for both orginal credit and credit recovery 
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Table A-3. Online Course Completions by Provider and Grade Level, 2014-2015 to 2017-2018 
2014-2015 2015-2016 2016-2017 2017-2018 

N % N % N % N % 

Apex Learning 9,830 100.0% 8,357 100.0% 8,286 100.0% 7,984 71.1% 
7th/8th Cy) 1.0% 128 1.5% 178 2.1% 116 1.5% 
9th 744 7.6% 747 8.9% 434 5.2% 630 7.9% 
10th 1,342 13.7% 1,511 18.1% 1,485 17.9% 1,052 13.2% 
11th 2,826 28.7% 2,209 26.4% 2,493 30.1% 2,080 26.1% 
12th 4,819 49.0% 3,762 45.0% 3,696 44.6% 4,106 51.4% 

Other Providers 100.0% 28.9% 
7th/8th 8.3% 1.2% 
9th 11.7% 12.5% 
10th 20.1% 23.6% 
11th 27.1% 41.6% 


12th 32.8% 21.1% 


Total Online Course 400.0% 100.0% 
Completions 


Sources: Historical Grades Files, 2014-2015, 2015-2016, 2016-2017, 2017-2018 


Notes: Other Providers includes Houston Community College (HCC), HIL, Texas TechD (Texas Tech Distance Learning Program), TxVSN 


StU (Texas Virtual School Netw ork), UT DL (University of Texas), and Additional Providers (API (American Preparatory Institute), 
Aventa, HVS, Nova Net, Penn Foster, Plato, SSCP, and Other Providers). 


Table A-4. Apex Courses Completions by Credit Type and Grade, 2014-2015 to 2017-2018 
2014-2015 2015-2016 2016-2017 2017-2018 
ne N= 9,830* N= 8,357* N= 8,286" N= 7,984" 
Credit Original Credit Original Credit Original Credit Original 
Recovery Credit Recovery Credit Recovery Credit Recovery Credit 
N % N % % % N % 
7th/8th <1% 1.0% 0.2%} 112 1.3% 0.0% 2.1% 0.1% | 111 1.4% 
9th 3.1% 4.5% 3.3% | 465 5.6% 1.4% 3.8% 1.8% | 479 6.0% 
10th 559 5.7% 7.9% 6.5% | 961 11.5% 4.6% 13.2% 4.2% | 712 8.9% 
11th 1,277 13.0% 15.6% 8.7% | 1,469 17.6% 8.7% 21.1% 8.0% | 1,437 18.0% 


12th 2,250 22.9% 25.9% 21.5%] 1,946 23.3% 15.7% 28.8% 14.0%| 2,969 37.2% 


USES San 4,394 5,388 3,364 4,953 2,526 5,723 2,243 
Completions 


Sources: Historical Grades Files, 2014-2015, 2015-2016, 2016-2017, 2017-2018 
Notes: Annual percentages may not total 100 because Advanced Placement and Dual Credit courses have been ommited from this table. 


*Across all four years, 2014-2015 through 2017-2018, Advanced Placement and Dual Credit accounted for <1 percent of Apex courses taken annually: 2014-2015 (n=48), 
2015-2016 (n=40), 2016-2017 (n=37), 2017-2018 (n=33) 
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Core Subjects 
English Language Arts (ELA) 


426 
268 
241 
561 


Mathematics 

Science 

Social Studies/History 
Non-Core Subjects 
261 
36 
5 


Languages Other than English 
PE/Health 
Other 


Total Online Course Completions 2,544 1,798 


Sources: Historical Grades Files, 2014-2015, 2015-2016, 2016-2017, 2017-2018 
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Credit Original (orc Voli 
Recovery Credit Recovery 


N % 


23.7% 
14.9% 
13.4% 
31.2% 


14.5% 
2.0% 
0.3% 


Original 
Credit 


N % 


268 
76 
118 
592 


582 
271 
39 


1,946 


13.8% 
3.9% 
6.1% 
30.4% 


29.9% 
13.9% 
2.0% 


Table A-5. Apex Courses Completions by Credit Type and Subject, 12th Grade Only, 2014-2015 to 2017-2018 


| 2014-2015 || 2015-2016 2016-2017 2017-2018 
N= 4,794 N= 3,744 N= 3,689 N= 4,085 


Credit Original Credit Original 
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Recovery Credit Recovery Credit 


314 
237 
162 
362 


171 


3 


1,302 


24. 
18. 
12; 
27. 


13. 
53 4.1% 
0.2% 


N 


1% 
2% 
4% 
8% 


260 23.3%] 238 8.0% 
144 12.9%] 157 5.3% 
145 13.0%} 250 8.4% 
315 28.2%} 904 30.4% 


1% 206 18.5%] 798 26.9% 
40 3.6%] 576 19.4% 


6 0.5% 


1,116 


16 


Apex Learning Online Instruction Report, 2017-2018 


Table A-6.Student Demographics and Characteristics, Grades 7-12 Only, 2016-2017 and 2017-2018 


2016-2017 2017-2018 


District Students enrolled in online courses District Students enrolled in online courses* 
District Other* District Other* 
N % N % 
13,543 é 13,930 
13,581 d : 13,370 
16,679 F 16,512 
13,641 13,630 
12,430 12,220 
11,090 11,584 
Black/African American 
American Indian 
Asian/Pacific Islander 
Hispanic/Latino 
White 
Two or More 
Unknown 3 
Female : 40,535 
Male F 40,711 
Unknown 
No 


Unknown 

No 25,853 
55,111 

Unknown 0 

No 74,021 
6,943 

Unknown 


Economically No 
Disadvantaged 


Unknown 
English Learner No 


Yes 
Unknown 


: : i 4 0.2 
2,082 100.0 | 81,246 | 100.0 4,277 100.0 1,904 100.0 


Sources: PEIMS Snapshot, 2016-2017, 2017-2018; Historical Grades Files, 2016-2017, 2017-2018; Chancery Student Demographics, May 2017, May 2018 
Note: A student who took online courses through both Apex Learning and Other Providers is counted twice. 
*Includes API (American Preparatory Institute), Aventa, HVS, Nova Net, Penn Foster, Plato, SSCP, and Other Providers 
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helt A-7. Graduate Counts by Demographic Characteristics, 2016-2017 and 2017-2018 


2016-2017 2017-2018 
Graduates Who pecans Who Graduates Who Graduates Who Graduates Who | GraduatesWho | Graduates Who Graduates Who 
All Graduates Neversrockant mpleted at Completed at Completed at Ailcraauntee Never Tookan Completed at Completed at Completed at 
Online Course! Least One eae Bee One nee Least One Other Online Course! Least One onire ae One Bae oo One ee 
Course’ Learning Course Online Course* Course Learning Course Online Course 
Ethnicity Black/African American 
American Indian 0.2 0.2 I é 01 I 0.2 
Asian/Pacific Islander 4.3 44 . : 77 i 4.9 
Hispanic/Latino 59.4 57.3 59.3 
White 10.4 11.7 z : 9.2 11.2 
Two or More 0.9 0.9 0.9 lee: 1.1 0.8 
Gender Female 5,528 | 52.1 1,644 55.3 | 5,729 3,596 | 51.3 527 | 1,658 
Male 5,085 47.9 3,081 47.4 2,004 48.8 1,633 44.8 5,335 3,417 48.7 47.3 1,618 
Gifted/Talented No 8,698 82.0 5,396 82.9 3,302 80.4 2,755 66.0 9,279 5,883 83.9 83.8 2,836 
Yes 1,915 18.0 1,111 17.1 804 19.6 522 34.0 1,785 1,130 16.1 16.2 440 
Special Education No 9,825 92.6 5,889 90.5 3,936 95.9 3,148 95.1 10,267 6,413 91.4 95.1 3,119 


Yes 788 74 618 95 170 4A 129 : 5.0 797 3 600 8.6 49 157 
English Learner No 8,823 83.1 5,461 83.9 3,362 81.9 2,679 82.4 8,629 5,535 78.9 76.4 2,496 
Yes 1,790 16.9 1,046 16.1 744 18.1 598 17.6 2,435 1,478 21.1 23.6 780 


10,613 | 100.0 6,507 100.0 4,106 100.0 3,277 100.0 | 11,064 7,013 100.0 100.0 3,276 


Sources: Historical Grades Files, 2016-2017, 2017-2018; Chancery Student Demographics, May 2017, May 2018; 2017, 2018 Chancery Graduates File 
' Nrefers to students who never took an online course of any type during high school. 
? Nrefers to students who took at least one online course of any type during high school. Includes Apex Learning, API (American Preparatory Institute), Aventa, HVS, Nova Net, Penn Foster, Plato, SSCP, and Other Providers 


3 Nrefers to students who took at least one Apex Learning online course during high school. 
* Nrefers to students who took at least one online course during high school other than Apex Learning. Includes API (American Preparatory Institute), Aventa, HVS, Nova Net, Penn Foster, Plato, SSCP, and Other Providers 
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Table A-8: Number of Apex Learning Courses by School and Provider, 2016-2017 and 2017-2018 


Apex Learning Difference 


2016-2017 |2017-2018 2016-2017 |2017-2018] 2016-2017 |2017-2018 
Beechnut Academy 0 
Garden Oaks 0 
Harper Alternative 0 
Leland Young Men's College Prep Academy 30 
Long Academy 78 
Rice School PK-8 1 
Rogers, T.H. 8 
Secondary DAEP 1 
Sharpstown International School 2 
Texas Connections Academy at Houston 0 
Young Women's College Prep Academy 21 
141 

Baylor College MS MS 0 0 0 1 0 1 0 
Burbank MS MS 0 0 0 1 0 1 0 
Chrysalis HS MS 0 9 9 0 0 0 9 
Deady MS MS 0 0 0 2 0 2 0 
Edison MS MS 0 0 0 1 0 1 0 
High School Ahead Academy MS 45 0 -45 0 0 45 0 
Lanier MS MS 0 4 4 11 1 11 5 
Meyerland MS MS 0 9 9 5 0 5 9 
Pershing MS MS 0 5 5) 4 0 4 5 
Pin Oak MS MS 1 26 25 15 1 16 27 
Revere MS MS 35 10 -25 0 0 35 10 
Tanglewood MS MS 0 1 1 0 0 0 1 
Williams MS MS 0 0 0 0 1 0 1 

81 64 -17 40 3 121 67 


Source: Historical Grades Files, 2016-2017, 2017-2018 
* In 2016-2017, Advanced Virtual Academy w as catagorized as an independent campus with 319 Apex courses taken by students. 
** Includes API (American Preparatory Institute), Aventa, HVS, Nova Net, Penn Foster, Plato, SSCP, and Other Providers 
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Table A-8: Number of Apex Learning Courses by School and Provider, 2016-2017 and 2017-2018 (continued) 


Apex Learning Difference Other** 


2016-2017 |2017-2018 2016-2017 |2017-2018] 2016-2017 |2017-2018 
Advanced Virtual Academy* : 
Austin HS 361 
Bellaire HS 649 
Carnegie HS 50 
Challenge Early College HS 16 
Chavez HS 
DeBakey HS 
Energized for STEM Central HS 
Energized for STEM West HS 
East Early College HS 
Eastwood Academy HS 
Energy Institute HS 
Furr HS 
Houston Academy for International Studies HS 
High School for Law and Justice 
High School for Performing and Visual Arts 
Heights HS 
Houston Math Science Technology Center HS 


Kashmere HS 

Lamar HS 

Liberty HS 

Madison HS 

Middle College HS - Fraga 
Middle College HS - Gulfton 
Milby HS 

Mount Carmel Academy HS 
North Forest HS 

North Houston Early College HS 
Northside HS 

Scarborough HS 
Sharpstown HS 

South Early College HS 
Sterling HS 

Victory Prep South 

Waltrip HS 

Washington HS 

Westbury HS 

Westside HS 

Wheatley HS 

Wisdom HS 

Worthing HS 

Yates HS 


12,169 11,230 


Source: Historical Grades Files, 2016-2017, 2017-2018 
* In 2016-2017, Advanced Virtual Academy was catagorized as an independent campus w ith 319 Apex courses taken by students. 
** Includes API (American Preparatory Institute), Aventa, HVS, Nova Net, Penn Foster, Plato, SSCP, and Other Providers 
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